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ABSTRACT 

The usefulness of the Cognitive Engagement in 
Cooperative Learning (CECL) model for evaluating the learning 
outcomes associated with various cooperative learning activities is 
explored. The instructions that a set of learners is given, however 
broad or specific, is called a script. These scripts are associated 
with different learning outcomes according to the amount of 
engagement that learners have with the material to be learned. The 
CECL model allows the placement of a given script along a continuum 
for the purpose of predicting how well students will learn the new 
material. This investigation was a pilot attempt to use meta-analysis 
to validate the model. Thirteen studies from the last 15 years were 
chosen. The investigation shows that meta-analysis justifies the use 
of the model fairly well, but is very much affected by choice and 
interpretation of studies included in the analysis. (Contains 1 
figure and 42 references.) (SLD) 
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This paper investigates the utility of the Cognitive Engagement in Cooperative Learning 
(CECL) model for evaluating the learning outcomes associated with various cooperative learning 
activities. The instructions that a set of learners is given, however broad or specific, is called a 
script. These scripts are associated with different learning outcomes according to the amount of 
engagement that learners have with the material to be learned. This model allows the placement of 
a given script along a continuum, for the purpose of predicting how well students will learn the 
new material. This investigation was a pilot attempt to use meta-analytic techniques to validate the 
model. Broadly stated, this investigation showed that meta-analysis justifies the use of the model 
fairly well, but is very much affected by choice and interpretation of studies included in the 
analysis. 



Background 



Cooperative Learning in Contemporary Perspective 

David Johnson, in an address to members of the International Society for Exploring 
Teaching Alternatives, asserted that education is in the midst of a paradigm shift (Rhem, 1992). 
The previous paradigm, Johnson believes, views the educational process as one of transferring 
knowledge from the teacher to the student, and since the student is merely a passive recipient, 
anyone with expertise can therefore teach. The new constructivist paradigm, Johnson believes, 
instead views the educational process as jointly constructed by teachers and students, in which the 
student is an active discoverer and transformer of knowledge and in which the teacher serves to 
develop students’ competencies and talents. By reconceptualizing the educational process in this 
manner, students will be better suited for life in the twenty-first century, in which they will be 
expected to take more responsibility at earlier ages, to think and solve complex problems and to 
sort through information and produce knowledge rather than merely reproduce it. In the global 
society of tomorrow, the learning process will be fundamentally linked to social interaction that 
goes well beyond the traditional teacher-student information-transmission relationship. In such an 
educational environment, students and teachers will work cooperatively between and among 
themselves, instead of individualistically or competitively, as they would have under the previous 
paradigm. 

Definition of Cooperative Learning 

There are three ways that cooperative learning differs from traditional learning scenarios: 
(1) it involves two or more people learning material together; (2) participants play equal roles as 
peers (instructor’s role is minimized); and (3) presumably, none of the learners are experts in the 
material to be learned (Hall, Rocklin, Dansereau, Skaggs, O’Donnell, Lambiotte & Young, 1988). 
Within this context fall many types of cooperative structures, such as dyads, rotated peer-teaching 
situations, reciprocal questioning groups, discussion groups or problem-solving groups. Those 
familiar with cooperative learning methods may use names for different structures such as 
cooperative integrated reading and comprehension (GIRC), co-op co-op, cooperative controversy, 
descubrimiento, jigsaw, learning together, numbered heads together, student team learning (STL), 
student teams-achievement divisions (STAD), teams-games-toumament (TGT), team assisted 
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individualization (TAI), and think-pair-share (Kagan, 1989/1990; Robinson, 1991; Slavin, 1991). 
Using structures such as these, cooperative groups may participate in various learning activities 
such as reviewing, summarizing, clarifying, explaining, questioning, debating, or reaching 
consensus. 

The Value of Cooperative Learning 

Cooperative learning has served as a valuable instructional tool for many years, and will 
very likely become even more foundational in light of the rising constructivist paradigm in 
education (Bredehoft, 1991; King, 1993; Rhem, 1992). Cooperative learning has been suggested 
as a valuable instructional alternative to traditional passive means of learning such as listening to 
and taking notes during a lecture (Bonwell & Eison, 1991; Johnson, Johnson & Smith, 1991; 
Whitman, 1988). In fact, Johnson points out that during the last 90 years, over 575 experimental 
studies (as well as hundreds of correlational studies) have compared the effectiveness of 
cooperative, competitive and individual approaches to learning (Johnson, Johnson & Smith, 1991; 
Rhem, 1992). 

The evidence collected by Johnson (Johnson, Johnson & Smith, 1991; Rhem, 1992) and 
Slavin (Slavin, 1989-1990; 1991) shows many positive results from the use of cooperative 
methods in the classroom, and such methods are often to be preferred. For instance," Johnson and 
colleagues (1991) recommend using cooperative learning whenever the goals of learning are highly 
important, mastery and retention are important, the task is complex or conceptual, problem solving 
is desired, divergent thinking or creativity is desired, quality of performance is expected, and 
higher-level reasoning strategies and critical thinking are needed. In addition, there are many 
positive non-cognitive outcomes of cooperative learning in college students such as higher 
retention rates, more involvement in learning, increased self-confidence and self-esteem, higher 
motivation, more positive attitudes toward the subject area and faculty relationships, interpersonal 
cohesion, more balanced psychological adjustment and increased feelings of social support 
(Johnson, Johnson & Smith, 1991; Slavin, 1989-1990; 1991). 

In addition to the outcomes discussed by Johnson (Johnson, Johnson & Smith, 1991; 
Rhem, 1992) and Slavin (Slavin, 1989-1990; 1991), others have found that particular learning 
outcomes can be predicted as a function of the design or structure of the learning groups (Hall et 
al., 1988; Kagan 1989/1990; King & Rosenshine, 1993; Lambiotte, Dansereau, O’Donnell, 

Young, Skaggs, Hall & Rocklin, 1987; Larson, Dansereau, O’Donnell, Hythecker, Lambiotte & 
Rocklin, 1985; Lew, Mesch, Johnson & Johnson, 1986; O’Donnell & Dansereau, 1992; 1993; 
Sharan, 1980; Smith, Johnson & Johnson, 1981). When considering the use of a cooperative 
learning strategy, an instructor needs to consider the structure of the learning task and the learners’ 
activities in light of the material to be learned (Dees 1991; Kagan 1989/1990; King 1991; Lambiotte 
et al., 1987). For instance, King (1991) found that the use of guided questioning within 
cooperative learning groups of fifth graders working with computer-assisted problems significantly 
enhanced learning compared to the group that did not use guided questioning. 

Scripting for Performance 

The term script has been adopted to describe the formal directions that a cooperative 
learning group or dyad would use to structure their activities (Lambiotte et al., 1987). A script 
outlines the learners’ activities in detailed description, and should be contrasted to directions that 
are more open in nature or do not have specified learning outcomes, such as, “Discuss the 
following topic...”, or, “Let’s go around the circle and name our favorite ice cream flavors”, or, 
‘Tell about an experience that happened to you...” A script might include directions for a group to 
read a passage and cover a series of related questions, or engage in a debate using a specified 
format and certain positions, or any of an unlimited number of activities designed to engage the 
learner in the learning process with the specified material. Much recent research on cooperative 
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learning has explicitly used the term script, and there is also a good bit of research that has 
implicitly used scripts to structure the learning activities. 

A series of studies conducted by O’ Donnell, Dansereau and colleagues (Dansereau, 1985) 
over the last ten to fifteen years have described many ways that scripts have been manipulated to 
produce various learning outcomes (Dansereau, 1983; 1985; Hall, et al., 1988; Lambiotte et al., 
1987; Larson, et al., 1985; McDonald, Larson, Dansereau & Spurlin 1985; O’Donnell & 
Dansereau, 1992; 1993; O’Donnell, Dansereau, Hall & Rocklin 1987; O’Donnell, Dansereau, 
Hythecker, Hall, Skaggs, Lambiotte & Young 1988; O’Donnell, Dansereau, Rocklin, Hythecker, 
Lambiotte, Larson & Young 1985; Spurlin, Dansereau, Larson & Brooks, 1984). For instance, 
Dansereau (1983; 1985), McDonald et al. (1985), O’Donnell et al. (1987), and Spurlin et al. 

(1984) examined the effects of a multiple summarization and corrective feedback script for learning 
expository text. O’Donnell, et al.(1988), on the other hand, compared prompting, preplanning, 
planning, and distributed planning scripts for use with learning a medical procedure. Further 
examples of script usage include scripts for learning text, lectures or procedures using strategies 
such as review, elaboration, multiple-step study strategies or reciprocal teaching (Hall et al., 1988; 
Lambiotte, et al., 1987; Larson, et al., 1985; O’Donnell, et al., 1985; O’Donnell & Adenwalia, 
1989; O’ Donnell & Dansereau, 1993). From a researcher’s standpoint, the use of scripts in recent 
cooperative learning research has served to create satisfactory experimental control over learning 
activities, so that those activities may be repeated consistently and learning outcomes may be 
predicted with more reliability. From a teaching perspective, however, the use of reliable, tested 
scripts can help with course planning such that certain cooperative learning activities can be 
scripted to acheive desired learning outcomes. 

Both Johnson (Rhem, 1992) and Slavin (1989-1990) indicate that cooperative learning is 
one of the most thoroughly researched instructional methods. Research on the use of scripts in 
cooperative learning, on the other hand, is a fairly recent development. Even though the research 
demonstrates consistent effects for the use of certain scripts on particular outcomes, the breadth of 
research still lacks theoretical unity. 

The Cognitive Engagement in Cooperative Learning Model 

The model presented here was created as a means of conceptually integrating the breadth 
and variety of research concerning cooperative learning scripts and corresponding learning 
outcomes. It is assumed in the CECL model that learning in cooperative groups is facilitated by 
two factors. The first factor is related to the depth of cognitive processing, or the “construction” of 
cognitive connections. The more new material is organized and elaborated upon, the better it will 
be encoded in a student’s memory. Organization is the process of structuring information in such a 
way that maximum inferences can be made from knowing a minimum of the information. Creating 
outlines and matrices are types of organizational processes. Elaboration is the process of 
associating the new information with information that is already known. The pairing of new 
material with personal experience, or with similar ideas would be elaboration. The second factor 
that facilitates learning in cooperative groups is the “reconstruction” of information. Just as 
information is organized and elaborated upon for it to be encoded into memory, it also can be 
pulled out, reorganized and reelaborated upon, especially in light of new information. The more 
information is recalled and re-encoded, the more it is “reconstructed.” Thus, the CECL model is 
based upon cognitive engagement— defined here as the degree to which constructive processes 
(organization and elaboration) and reconstructive processes are scripted in a given cooperative 
learning activity. 

Along the left-to-right continuum of the model (Figure 1), scripts can be placed according 
to the constructive and reconstructive processes that they promote in cooperative groups. At the far 
left end of the continuum are those scripts which do little to actively promote organiztion, 
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elaboration or reconstruction. The type of script placed at this end of the model might be the type 
that calls for a cooperative group to summarize a lecture or a reading. In summarization, little 
organization is done, and elaboration may consist of nothing more than repeating what was said in 
the learner’s own words. Other scripts, however, may call for more constructions and 
reconstructions of information. At the far right end of the continuum are those scripts in which 
learners challenge each others’ reasoning processes directly. This challenge may cause learners to 
rethink, reassess, or restructure their thinking about a particular issue or belief. A debate would 
characterize the type of cooperative script that is placed at this end of the continuum. 

Method 



Meta-analysis is a procedure for comparing mutliple studies using the siungle dimension of 
effect size (ES). The exact procedures used in this investigation parallel those outlined by Wolf 
(1986). To begin, studies from the last 15 years were chosen for inclusion by their relevance to the 
methods of cooperative learning described here. The criterion for used for inclusion were: 

1) The instructions given to the learners were in the form of a broad “script”; In other 
words, cooperative groups were told what to do with their time together in a formal 
manner. 

2) The learning was to take place in the form of declarative, conditional or procedural 
knowledge that could be measured using objective measuring techniques. Recall was the 
most prevalent form of performance measure. Measures of transfer, or successful 
completion of a procedure were not used. 

3) The learning that occurred in these settings may have taken place in one session, or may 
be the cumulative result of many sessions using the same script over time. 

4) Studies that involved measures in two different subject areas, or replications, were 
treated as if each one was a separate study. The weighting of results, discussed later, 
assured that this would not be a biasing procedure. 

5) For a study to be included it had to have a control group that involved individualized, or 
traditional learning assignments. 

For each of the studies, measures of effect size (ES) were derived, using either means and 
standard deviations, t statistics or F statistics. Wolf (1986) equation 8 and those on p. 35 were 
used. Effect sizes were recorded in the matrix in Table 1, according to the type of script used in 
each of the groups studied. Table 1 breaks the CECL model into four divisions, for practical utility 
in this meta-analysis. The divisions are: Simple Engagement- non-group, Simple Engagement- 
group (construction-organization, low elaboration), Moderate Engagement (construction- deep 
elaboration), and High Engagement (construction and reconstruction). In many cases, several 
scripts were compared, and so each script was considered according to its degree of potential in 
provoking cognitive engagement. Scripts were also weighted according to equation 27 (Wolf, 
1986), since in most cases, the experimental and control groups were nearly equal and were close 
to or greater than 10. Thus, average effect size could be generated for each of the four categories 
using equation 26. 

Results 



As it turns out, the criteria for inclusion were a lot more limiting than at first suspected. Of 
the many types of cooperative learning groups that have been conducted, very few use a formal 
script that is easily broken down into a cognitive engagement perspective. For instance, in the 
structure called Student Teams Achievement Division (Slavin, 1988), learners are told not only to 
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quiz each other about the material, but to continue quizzing and discussing until everyone in the 
group understands the material thoroughly. Students are then held individually accountable on a 
subsequent test, and teams are rewarded when group members do well. The directions for the 
learners are not explicit in what strategies to use to learn the material. This exemplifies a majority 
of the research that has been conducted on cooperative learning; most examine the reward structure 
(like individual accountability) and speak of the social benefits (like increased motivation). 

Because of the difficulty of finding studies that fit the inclusion criteria, for this pilot investigation, 
only 13 studies were examined. 

The analyses showed that across the four categories, the average effect size increased, 
lending credence to the CECL model. The largest difference occurred between the first two and 
last two categories, almost .3 of an effect size. However encouraging these results are, 
unfortunately chi-square tests for the homogeneity of variance across the four categories showed 
that in the second and forth groups, they were not homogeneous (p=.165 for simple engagement 
and p=. 16 for deep engagement). Future analyses should therefore concentrate on including more 
similar studies. 

Discussion 



Although the evidence provides broad evidence for the utility and validity of the CECL 
model, this study has many limitations that should be considered. First of all, there were only 13 
studies included in this investigation. As such, the effect sizes were greatly dependent on which 
studies were included, and how the scripts were interpreted to fit within the four categories. Of 
these 13 studies, each one was conducted very differently, so the amount of interpretation was 
high. For additional research using this method, reliability could be increased by reaching 
consensus among several researchers before inclusion in the meta-analysis. 

In general, however, the results were encouraging, because they support the CECL model. 
Given more investigation and further validation, CECL model could be very useful in helping 
instructors consider how to use cooperative groups to the greatest learning benefit. 
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Figure 1 - CCCL Model and Meta Analysis Results 
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